Comparison of Models: Intelligence, Performance & Price Analysis
Comparison and analysis of AI models across key performance metrics including quality, price, output speed, latency, context window & others. Click on any model to see detailed metrics. For more details including relating to our methodology, see our FAQs.
Model Comparison Summary
GPT-5 (high) and GPT-5 (medium) are the highest intelligence models, followed by 
Grok 4 & o3-pro.Output Speed (tokens/s):
Gemini 2.5 Flash-Lite (Reasoning) (498 t/s) and 
Nova Micro (358 t/s) are the fastest models, followed by Gemini 2.5 Flash-Lite & gpt-oss-20B (high).Latency (seconds):
Aya Expanse 8B (0.13s) and Command-R (Mar '24) (0.15s) are the lowest latency models, followed by 
LFM 40B & Aya Expanse 32B.Price ($ per M tokens): Gemma 3 4B ($0.03) and Gemma 3n E4B ($0.03) are the cheapest models, followed by 
Llama 3.2 3B & 
Ministral 3B.Context Window: Llama 4 Scout (10m) and 
MiniMax-Text-01 (4m) are the largest context window models, followed by Gemini 2.0 Pro Experimental & Gemini 1.5 Pro (Sep).Highlights
Intelligence
Artificial Analysis Intelligence Index
Artificial Analysis Intelligence Index by Model Type
Artificial Analysis Intelligence Index by Open Weights vs Proprietary
Artificial Analysis Coding Index
Artificial Analysis Math Index
Intelligence Evaluations
Intelligence vs. Price
Intelligence vs. Output Speed
GPT-5 (minimal) (83.93,43.8)
Click for more information
Intelligence vs. End-to-End Response Time
- Input time: Time to receive the first response token
- Thinking time (only for reasoning models): Time reasoning models spend outputting tokens to reason prior to providing an answer. Amount of tokens based on the average reasoning tokens across a diverse set of 60 prompts (methodology details).
- Answer time: Time to generate 500 output tokens, based on output speed
Intelligence Index Token Use & Cost
Output Tokens Used to Run Artificial Analysis Intelligence Index
Intelligence vs. Output Tokens Used in Artificial Analysis Intelligence Index
Cost to Run Artificial Analysis Intelligence Index
Intelligence vs. Cost to Run Artificial Analysis Intelligence Index
Context Window
Context Window
Intelligence vs. Context Window
Pricing
Pricing: Input and Output Prices
Intelligence vs. Price (Log Scale)
Pricing: Cached Input Prompts
Pricing: Image Input Pricing
Performance Summary
Output Speed vs. Price
Latency vs. Output Speed
Speed
Measured by Output Speed (tokens per second)
Output Speed
Output Speed by Input Token Count (Context Length)
Output Speed Variance
Output Speed, Over Time
Latency
Measured by Time (seconds) to First Token
Latency: Time To First Answer Token
Latency: Time To First Token
Time to First Token by Input Token Count (Context Length)
Time to First Token Variance
Time to First Token, Over Time
End-to-End Response Time
Seconds to output 500 Tokens, calculated based on time to first token, 'thinking' time for reasoning models, and output speed
End-to-End Response Time
- Input time: Time to receive the first response token
- Thinking time (only for reasoning models): Time reasoning models spend outputting tokens to reason prior to providing an answer. Amount of tokens based on the average reasoning tokens across a diverse set of 60 prompts (methodology details).
- Answer time: Time to generate 500 output tokens, based on output speed
End-to-End Response Time by Input Token Count (Context Length)
End-to-End Response Time, Over Time
- Input time: Time to receive the first response token
- Thinking time (only for reasoning models): Time reasoning models spend outputting tokens to reason prior to providing an answer. Amount of tokens based on the average reasoning tokens across a diverse set of 60 prompts (methodology details).
- Answer time: Time to generate 500 output tokens, based on output speed
Claude 4 Opus (Extended Thinking)
DeepSeek R1 0528 Qwen3 8B
R1 1776
Phi-4
Solar Pro 2
Llama 3.1 Nemotron Instruct 70B
Kimi K2
Granite 3.3 Instruct 8B
Reka Flash 3
DeepHermes 3 - Llama-3.1 8B Preview
EXAONE 4.0 32B
Jamba 1.7 Large
QwQ 32B
OpenChat 3.5 (1210)
DBRX Instruct
Llama 3.1 Tulu3 405B
Arctic Instruct
Yi-LargeModels compared: OpenAI: GPT 4o Audio, GPT 4o Realtime, GPT 4o Speech Pipeline, GPT-3.5 Turbo, GPT-3.5 Turbo (0125), GPT-3.5 Turbo (0301), GPT-3.5 Turbo (0613), GPT-3.5 Turbo (1106), GPT-3.5 Turbo Instruct, GPT-4, GPT-4 Turbo, GPT-4 Turbo (0125), GPT-4 Turbo (1106), GPT-4 Vision, GPT-4.1, GPT-4.1 mini, GPT-4.1 nano, GPT-4.5 (Preview), GPT-4o (April 2025), GPT-4o (Aug '24), GPT-4o (ChatGPT), GPT-4o (March 2025), GPT-4o (May '24), GPT-4o (Nov '24), GPT-4o Realtime (Dec '24), GPT-4o mini, GPT-4o mini Realtime (Dec '24), GPT-5 (high), GPT-5 (low), GPT-5 (medium), GPT-5 (minimal), GPT-5 mini, GPT-5 nano, gpt-oss-120B (high), gpt-oss-20B (high), o1, o1-mini, o1-preview, o1-pro, o3, o3-mini, o3-mini (high), o3-pro, and o4-mini (high), Meta: Code Llama 70B, Llama 2 Chat 13B, Llama 2 Chat 70B, Llama 2 Chat 7B, Llama 3 70B, Llama 3 8B, Llama 3.1 405B, Llama 3.1 70B, Llama 3.1 8B, Llama 3.2 11B (Vision), Llama 3.2 1B, Llama 3.2 3B, Llama 3.2 90B (Vision), Llama 3.3 70B, Llama 4 Behemoth, Llama 4 Maverick, Llama 4 Scout, and Llama 65B, Google: Gemini 1.0 Pro, Gemini 1.0 Ultra, Gemini 1.5 Flash (May), Gemini 1.5 Flash (Sep), Gemini 1.5 Flash-8B, Gemini 1.5 Pro (May), Gemini 1.5 Pro (Sep), Gemini 2.0 Flash, Gemini 2.0 Flash (exp), Gemini 2.0 Flash Thinking exp. (Dec '24), Gemini 2.0 Flash Thinking exp. (Jan '25), Gemini 2.0 Flash-Lite (Feb '25), Gemini 2.0 Flash-Lite (Preview), Gemini 2.0 Pro Experimental, Gemini 2.5 Flash, Gemini 2.5 Flash (Reasoning), Gemini 2.5 Flash (April '25), Gemini 2.5 Flash (April '25) (Reasoning), Gemini 2.5 Flash-Lite, Gemini 2.5 Flash-Lite (Reasoning), Gemini 2.5 Pro, Gemini 2.5 Pro (Mar '25), Gemini 2.5 Pro (May' 25), Gemini Experimental (Nov), Gemma 2 27B, Gemma 2 2B, Gemma 2 9B, Gemma 3 12B, Gemma 3 1B, Gemma 3 27B, Gemma 3 4B, Gemma 3n E2B, Gemma 3n E4B, Gemma 3n E4B (May '25), Gemma 7B, and PALM-2, Anthropic: Claude 2.0, Claude 2.1, Claude 3 Haiku, Claude 3 Opus, Claude 3 Sonnet, Claude 3.5 Haiku, Claude 3.5 Sonnet (June), Claude 3.5 Sonnet (Oct), Claude 3.7 Sonnet Thinking, Claude 3.7 Sonnet, Claude 4 Opus, Claude 4 Opus Thinking, Claude 4 Sonnet, Claude 4 Sonnet Thinking, Claude 4.1 Opus, Claude 4.1 Opus Thinking, and Claude Instant, Mistral: Codestral (Jan '25), Codestral (May '24), Codestral-Mamba, Devstral Medium, Devstral Small, Devstral Small (May '25), Magistral Medium, Magistral Medium (Jul '24), Magistral Small, Magistral Small (Jul '25), Ministral 3B, Ministral 8B, Mistral 7B, Mistral Large (Feb '24), Mistral Large 2 (Jul '24), Mistral Large 2 (Nov '24), Mistral Medium, Mistral Medium 3, Mistral NeMo, Mistral Saba, Mistral Small (Feb '24), Mistral Small (Sep '24), Mistral Small 3, Mistral Small 3.1, Mistral Small 3.2, Mixtral 8x22B, Mixtral 8x7B, Pixtral 12B, and Pixtral Large, DeepSeek: DeepSeek Coder V2 Lite, DeepSeek LLM 67B (V1), DeepSeek Prover V2 671B, DeepSeek R1 (FP4), DeepSeek R1 (Jan '25), DeepSeek R1 0528, DeepSeek R1 0528 Qwen3 8B, DeepSeek R1 Distill Llama 70B, DeepSeek R1 Distill Llama 8B, DeepSeek R1 Distill Qwen 1.5B, DeepSeek R1 Distill Qwen 14B, DeepSeek R1 Distill Qwen 32B, DeepSeek V3 (Dec '24), DeepSeek V3 0324 (Mar '25), DeepSeek-Coder-V2, DeepSeek-V2, DeepSeek-V2.5, DeepSeek-V2.5 (Dec '24), DeepSeek-VL2, and Janus Pro 7B, Perplexity: PPLX-70B Online, PPLX-7B-Online, R1 1776, Sonar, Sonar 3.1 Huge, Sonar 3.1 Large, Sonar 3.1 Small , Sonar Large, Sonar Pro, Sonar Reasoning, Sonar Reasoning Pro, and Sonar Small, xAI: Grok 2, Grok 3, Grok 3 Reasoning Beta, Grok 3 mini, Grok 3 mini Reasoning (low), Grok 3 mini Reasoning (high), Grok 4, Grok Beta, and Grok-1, OpenChat: OpenChat 3.5, Amazon: Nova Lite, Nova Micro, Nova Premier, and Nova Pro, Microsoft Azure: Phi-3 Medium 14B, Phi-3 Mini, Phi-4, Phi-4 Mini, Phi-4 Multimodal, Phi-4 mini reasoning, Phi-4 reasoning, and Phi-4 reasoning plus, Liquid AI: LFM 1.3B, LFM 3B, and LFM 40B, Upstage: Solar Mini, Solar Pro, Solar Pro (Nov '24), Solar Pro 2, Solar Pro 2 , Solar Pro 2 (Reasoning), and Solar Pro 2 (Reasoning), Databricks: DBRX, MiniMax: MiniMax M1 40k, MiniMax M1 80k, and MiniMax-Text-01, NVIDIA: Cosmos Nemotron 34B, Llama 3.1 Nemotron 70B, Llama 3.1 Nemotron Nano 4B v1.1 (Reasoning), Llama 3.1 Nemotron Nano 8B, Llama 3.3 Nemotron Nano 8B v1 (Reasoning), Llama Nemotron Ultra Reasoning, Llama 3.3 Nemotron Super 49B v1, Llama 3.3 Nemotron Super 49B Reasoning, Llama Nemotron Super 49B v1.5, and Llama Nemotron Super 49B v1.5 (Reasoning), IBM: Granite 3.0 2B, Granite 3.0 8B, Granite 3.3 8B, Granite 3.3 8B (Reasoning), Granite 4.0 Tiny, and Granite Vision 3.3 2B, Inceptionlabs: Mercury, Mercury Coder Mini, Mercury Coder Small, and Mercury Instruct, Reka AI: Reka Core, Reka Edge, Reka Flash (Feb '24), Reka Flash, Reka Flash 3, and Reka Flash 3.1, LG AI Research: EXAONE 4.0 32B, EXAONE 4.0 32B (Reasoning), and EXAONE Deep 32B, Xiaomi: MiMo 7B RL, Baichuan: Baichuan 4 and Baichuan M1 (Preview), vercel: v0-1.0-md, Apple: Apple On-Device, Other: LLaVA-v1.5-7B, Z AI: GLM-4 32B, GLM-4 9B, GLM-4-Air, GLM-4 AirX, GLM-4 FlashX, GLM-4-Long, GLM-4-Plus, GLM-4.1V 9B Thinking, GLM-4.5, GLM-4.5-Air, GLM-Z1 32B, GLM-Z1 9B, GLM-Z1 Rumination 32B, and GLM-Zero (Preview), Cohere: Aya Expanse 32B, Aya Expanse 8B, Command, Command A, Command Light, Command R7B, Command-R, Command-R (Mar '24), Command-R+ (Apr '24), and Command-R+, Bytedance: Duobao 1.5 Pro, Seed-Thinking-v1.5, Skylark Lite, and Skylark Pro, AI21 Labs: Jamba 1.5 Large, Jamba 1.5 Large (Feb '25), Jamba 1.5 Mini, Jamba 1.5 Mini (Feb 2025), Jamba 1.6 Large, Jamba 1.6 Mini, Jamba 1.7 Large, Jamba 1.7 Mini, and Jamba Instruct, Snowflake: Arctic and Snowflake Llama 3.3 70B, Alibaba: QwQ-32B, QwQ 32B-Preview, Qwen Chat 14B, Qwen Chat 72B, Qwen Chat 7B, Qwen1.5 Chat 110B, Qwen1.5 Chat 14B, Qwen1.5 Chat 32B, Qwen1.5 Chat 72B, Qwen1.5 Chat 7B, Qwen2 72B, Qwen2 Instruct 7B, Qwen2 Instruct A14B 57B, Qwen2-VL 72B, Qwen2.5 Coder 32B, Qwen2.5 Coder 7B , Qwen2.5 Instruct 14B, Qwen2.5 Instruct 32B, Qwen2.5 72B, Qwen2.5 Instruct 7B, Qwen2.5 Max, Qwen2.5 Max 01-29, Qwen2.5 Omni 7B, Qwen2.5 Plus, Qwen2.5 Turbo, Qwen2.5 VL 72B, Qwen2.5 VL 7B, Qwen3 0.6B, Qwen3 0.6B (Reasoning), Qwen3 1.7B, Qwen3 1.7B (Reasoning), Qwen3 14B, Qwen3 14B (Reasoning), Qwen3 235B, Qwen3 235B (Reasoning), Qwen3 235B 2507 (Non-reasoning), Qwen3 235B 2507 (Reasoning), Qwen3 30B, Qwen3 30B (Reasoning), Qwen3 30B 2507 (Non-reasoning), Qwen3 30B 2507 (Reasoning), Qwen3 32B, Qwen3 32B (Reasoning), Qwen3 4B, Qwen3 4B (Reasoning), Qwen3 4B 2507 (Non-reasoning), Qwen3 4B 2507 (Reasoning), Qwen3 8B, Qwen3 8B (Reasoning), Qwen3 Coder 30B, and Qwen3 Coder 480B, and 01.AI: Yi-Large and Yi-Lightning.